Visual tracking for multi-modality computer-assisted image guidance

نویسندگان

  • Ehsan Basafa
  • Pezhman Foroughi
  • Martin Hoßbach
  • Jasmine Bhanushali
  • Philipp J. Stolka
چکیده

With optical cameras, many interventional navigation tasks previously relying on EM, optical, or mechanical guidance can be performed robustly, quickly, and conveniently. We developed a family of novel guidance systems based on widespectrum cameras and vision algorithms for real-time tracking of interventional instruments and multi-modality markers. These navigation systems support the localization of anatomical targets, support placement of imaging probe and instruments, and provide fusion imaging. The unique architecture – low-cost, miniature, in-hand stereo vision cameras fitted directly to imaging probes – allows for an intuitive workflow that fits a wide variety of specialties such as anesthesiology, interventional radiology, interventional oncology, emergency medicine, urology, and others, many of which see increasing pressure to utilize medical imaging and especially ultrasound, but have yet to develop the requisite skills for reliable success. We developed a modular system, consisting of hardware (the Optical Head containing the mini cameras) and software (components for visual instrument tracking with or without specialized visual features, fullyautomated marker segmentation from a variety of 3D imaging modalities, visual observation of meshes of widelyseparated markers, instant automatic registration, and target tracking and guidance on real-time multi-modality fusion views). From these components, we implemented a family of distinct clinical and pre-clinical systems (for combinations of ultrasound, CT, CBCT, and MRI), most of which have international regulatory clearance for clinical use. We present technical and clinical results on phantoms, exand in-vivo animals, and patients.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Fast, Intuitive, Vision-Based: Performance Metrics for Visual Registration, Instrument Guidance, and Image Fusion

We characterize the performance of an ultrasound+ computed tomography image fusion and instrument guidance system on phantoms, animals, and patients. The system is based on a visual tracking approach. Using multi-modality markers, registration is unobtrusive, and standard instruments do not require any calibration. A novel deformation estimation algorithm shows externally-induced tissue displac...

متن کامل

Visual Instrument Guidance in Minimally Invasive Robot Surgery

Surgical tool tracking is an important key functionality for many high-level tasks such as the visual guidance of surgical instruments or automated camera control. Readings from robot encoders and the kinematic chain are usually error prone in this kind of complex setup, but still allow for a coarse pose estimation of the instruments in image space. This information can be utilized to (re-)init...

متن کامل

Augmented Reality Guidance with Multimodality Imaging Data and Depth-Perceived Interaction for Robot-Assisted Surgery

Image-guided surgical procedures are challenged by mono image modality, twodimensional anatomical guidance and non-intuitive human-machine interaction. The introduction of Tablet-based augmented reality (AR) into surgical robots may assist surgeons with overcoming these problems. In this paper, we proposed and developed a robot-assisted surgical system with interactive surgical guidance using t...

متن کامل

Visual Tracking using Learning Histogram of Oriented Gradients by SVM on Mobile Robot

The intelligence of a mobile robot is highly dependent on its vision. The main objective of an intelligent mobile robot is in its ability to the online image processing, object detection, and especially visual tracking which is a complex task in stochastic environments. Tracking algorithms suffer from sequence challenges such as illumination variation, occlusion, and background clutter, so an a...

متن کامل

A Non-disruptive Technology for Robust 3D Tool Tracking for Ultrasound-Guided Interventions

In the past decade ultrasound (US) has become the preferred modality for a number of interventional procedures, offering excellent soft tissue visualization. The main limitation however is limited visualization of surgical tools. A new method is proposed for robust 3D tracking and US image enhancement of surgical tools under US guidance. Small US sensors are mounted on existing surgical tools. ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017